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ABSTRACT 

University supervisors' evaluations of student 
teachers were assessed to determine if the cognitive attainment of 
pupils taught by the student teachers was a rating factor. The sample 
consisted of 82 secondary level student teachers participating in a 
competency based teacher education program. Data /^"ted for ; he 
study included a summary evaluation instrument, developed by the 
student teachers, to ascertain their pupils' /j;"*;™;* 
levels. The student teacher supervisors recorded their ratings of 
student teachers' instructional effectiveness on an evaluation 
profile scale consisting of 20 instructional skills and ^jht 
personal competencies. Final ratings were obtained from a three way 
Conference among the student teacher, the university supervisor and 
the cooperating teacher. Only four cf the 28 ratings areas JjJ* 
to relate significantly to learner achievement: (1) developing lesson 
plans; (2) using different levels of classroom questions; (3) 
performance while student teaching two : week units; and (4) Personal 
energy level. These findings have implications for student teacher 
evaluation procedures, since they refute the assumption that high 
student teacher ratings by their supervisors is related to high 
learner achievement. (FG) 
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Relations Among Final Supervisor Skill Ratings of Student 
Teachers and Cognitive Attainment Values of Learners 
Taught by Student Teichers 



Assessing the teaching skills of teaching candidates is a perennial 
topic addressed in conferences and journals of education. Countless approaches 
for assessing student teachers have been developed, implemented and reported. 
(Henry, Beasley, 1972; Kay, 1978; Medley, 1978; Tikunoff, Ward, "978) Nearly 
a decade ago, VTeber (1974) identified two major positions evolving from the 
Competency "--'"i Teacher Education (CBTE) movement regarding student teacher 
assessment . - .e included procedures which examine the instructional skills 
of teachin .dates on the ne hand, and techniques for collecting learner 

achievement ^....sequence criteria) information on the other. For the past sev- 
eral years efforts have been directed to the consequence approach of student 
teacher assessment in our laboratory. A number of these inquiries have examined 
the potential of assessing the competence of student teachers on the basis of 
cognitive attainment demonstrated by their learners (Denton, 1979, 1980; Denton, 
Norris, 1980, 1981; Denton, Mabry, 1981; Denton, Tooke, 1981). A number of 
t^ese'papers have reported modest relations between general teaching skill as- 
sessments of student teachers and cognitive attainment values of learners of 
the student teachers. In these reports, general teaching skill assessment was 
operationally defined as the sum of supervisor ratings of the student teact er 
over several instructional skills. Reflecting on these efforts, we realized 
the importan.3 of examining the relation of each instructional skill rating to 
learner cognitive attainment. Thus, the inquiry was undertaken to answer the 
following research question: 

ARE COGNITIVE ATTAINMENT DATA FROM LEARNERS TAUGHT BY STUDENT TEACHERS 
RELATED TO FINAL INDIVIDUAL TEACHING SKILL RATINGS BY THOSE WHO SUPER- 
VISED THE STUDENT TEACHERS? 
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ORGANIZATION OF INVESTIGATION 

Program Description 

This investigation was conducted in the educational curriculum and 
instruction department at Texas A&M University. The teacher preparation 
program being examined in the ivestigation is a competency based program fir 
secondary level teachers fashioned around a diagnostic-prescriptive model of 
instruction (Armstrong, Denton, Savage, 1978). This model conceptualizes 
teaching as a series of events requiring five distinct sets of instructional 
skills, that is: Specifying Perfomance Objectives, Diagnosing Learners, Se- 
lecting Instructional Strategies, Interacting with Learners, and Evaluating the 
Effectiveness of Instruction. 

A full semsester-full day student teaching program with twelve semester 
hours being awarded for successful completion of the course is the culminating 
experience in this preparation program. During this experience, each student 
teacher is required to develop and implement two instructional units each of 
approximately two weeks duration. The instructional units are to include: per- 
formance objectives, and diagnostic pretest to determine whether prerequisite 
knowledges and skills are present, instructional strategies addressed to 6ach 
. performance objective, and criterion- referenced instruments. These units must 
be deemed acceptable and appropriate by both the classroom supervising teacher 
and the university supervisor prior to implementation. Some time ago, a multi- 
stage evaluation system was established to monitor the development and implementa- 
tion of this competency based program (Denton, 1977). Evaluation of student 
teachers in this system includes supervisor ratings based on in-class observa- 
tions and 'ratings of instructional materials produced by the student teacher. 
Generally, six supervisor ratings are completed during a semester. These 
ratings are recorded on an Evaluation Profile instrument. It may be of sig- 
nificance that the final evaluation for each student teacher recorded on this 
instrument represents a consensus rating resulting froir a three-way conference 
between the student teacher, classroom supervisor and university supervisor. 
In addition, a Curriculum Context Checklis t for rating the components of each 
instructional unit is completed by the university supervisor. 

Student teachers are also requested to contribute to the formative evalua- 
tion process by completing weekly reflection sheets throughout the semester. 
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Further, summative procedures are conducted by student teachers at the con- 
clusion of each unit, where summaries of learners' performances are recorded 
on Summary Evaluation of Unit Forms . These self-evaluation experiences are 
consistent with the final component of the diagnostic-prescriptive model of 
instruction. 

Only one type of data was collected for this investigation which ordinarily 
is not collected during student teaching, that being, criterion referenced 
learner attainment data. In this investigation, student teachers retained the 
unit test responses of learners after providing feedback to the learners re- 
garding their performance. These data were subsequently used to develop a 
criterion-referenced summary on each learner. This summary is a record. of 
each learner regarding his/her individual performance with respect to each per- 
formance objective included in the unit. In addition, pretest and post-test 
scores were recorded for each learner on the summary. The objective attainment 
data expressed as the percentage of objectives attained in unit two for each 
learner have served as the dependent variable in this investigation. 

Sample : 

Data from 82 secondary level student teachers and 9001 learners taught by 
the student teachers comprised the total sample for this inquiry. The unit 
of analysis for this array of data was the student teacher. The student teachers 
were supervised by five university supervisors over the course of five semesters 
(Spring "78 through Spring '80). The university supervisors during this period 
had prior experience as supervisors ranging from one semester to three years. 
Due to this experience, these supervisors have established themselves profes- 
sionally among classroom supervisors and building administrators with whom they 
worked. Further, each supervisor was well versed on the diagnostic-prescriptive 
model of instruction on which the preparation program and corresponding 28 item 
evaluation profile (rating scale) were bised. 

Instrumentation: • 
While a variety of scales and criterion- referenced instruments were used 
to obtain measures of independent and dependent variables for program evalu- 
ation purposes, data requirements for this inquiry were met by the summary 
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evaluation of unit and evaluation profile forms. The summary evaluation form 
requires Vn estimate of the achievement level and socio-economic level of the 
learners in addition to the actual number of class periods required to teach 
the unit. Perhaps the most significant information collected among all data 
is recorded on this form by the student teacher; this data being achievement 
information (learner attainment of individual unit objectives, pretest scores, 
and unit post-test scores). Criterion-referenced tests developed by the student 
teacher are used to provide these learner attainment data. An evaluation 
strategy developed by McNeil and Popham (1973) provided guidelines for accom- 
plishing this t.sk without disrupting the instructional program of the hcst 
school of the student teaching program. Additional discussion of this pro- 
cedure is provided elsewhere (Denton, Norris, 1981 ^ . 

The evaluation profile scale was used to recoL . the supervisor ratings of 
the instructional effectiveness of the student teacher. The scale consists of 
twenty-eight Likert type items divided into two categories, that is, instruc- 
tional skills, (20 items) and personal characteristics (8 ifems). Ratings to 
each item range from excellent to inadequate. An alpha co-efficient of .94 
determined for this instrument suggests a high degree of internal consistency 
among items on the scale. 

Collecting Data; 

Final ratings of the student teacher on the evaluation profile were con- 
sensus ratings recorded during a three-way conference among the student teacher, 
classroom supervisor and university supervisor. In addition, cognitive attain- 
ment data on each learner were recorded by the student teacher. These cognitive 
data were collected at the conclusion of the second instructional unit taught 
by the student teachers. While the cognitive data of learners included many 
variables, the sum of unit two objectives attained by the learners became the 
cognitive attainment variable of interest. 
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RESULTS AND DISCUSSION 



Zero order correlations were calculated between the average number, of ob- 
jectives achieved by learners of the student teacher with individual consensus 
ratings in the evaluation profile of that student teacher. Table 1 presents 
the results of those calculations. 

[place Table 1 about here] 

Supervisor ratings of student teachers which relate to learner attainment 
were found to be ratings of student teachers' ability to; develop lesson plans 
(r=.l9, p-.05), use different levels of classroom questions (r=.16, p=.08), and 
the overall rating of performance while teaching two week units (r= -.18, p- .06). 
One rating among the personal characteristics of student teachers, i.e. the 
energy, was found to relate to learner cognitive attainment modestly (r=.15, 
p=.10). 

3ecause only 4 of 28 supervisor ratings were found to relate modestly to 
cognitive attainment values of learners, a negative response appears appro- y 
priate for the research question of this inquiry. However, it does appear that 
those teaching skills, which correlate with learner attainment are directly ob- 
servable, while the global rating which was more inferential, yielded a negative 

correlation. 0 

It is somewhat disappointing that the primary evaluation procedure currently 
used in cur student teaching program yields so few items that relate' i odestly 
to cognitive growth of learners. tip doubt the supervisor ratings represent 
processes of teaching, while the cognitive attainment scores are instances of 
products of teaching. Yet our evaluation procedures, which place so much 
weight on the supervisory ratings, assume that the instructional processes 
on the scale are related to learner attainment or produ~«- = of instruction. 
In other words, if a student teacher is rated highly across the tweaty instruc- 
tional skills, then that candidate's learners is expected to achieve high scores. 
Conversely, if the student teacher fails to demonstrate excellent facility with 
various instructional skills on the scale, then the learners, likely, will not ^ 
be quite as successful. The values produced in this inquiry tend to refute 
this assumption. Possible explanations for this finding include a litany of 
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psychometric concerns associated with the variables under consideration as 
well as the objectivity of evaluating a colleague and protege, with the future 
of the student teacher, at stake. 

It is quite reasonable, that so much effort and growth have occurred during 
the student teaching experience, that the scale value represents a rating of 
perseverence and improvement rather than demonstrated performance. Whatever 
the reasons the outcomes of this inquiry do suggest that multiple sources of 
information be used to certify the competence of a teaching candidate rather 
than relying solely on supervisor ratings. 
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Table 1 



Correlations Between 



Ratings of Student Teachers, and Cognitive Attainment of Learners Taught by Student Teachers. 



Instructional 
6kill Label 

Lesson plan 
deve lopment 



Use of Per. ob- 
jectives 

Diagnostics used 

Remediation usecf 

Content mastery 
exhibited-' 

Use of- duplicating 
equipment 

Use of Audio-Visual 
equipment 

Introducing and 
concluding lessons 

Appropriateness of 
inst. method 

Variety of stimuli 
used 



Role Model 
^romptaess 
Cooperation 
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Zero Order 
Correlation 



i ■ > 



.19 
.04 

-.12 

-.12 
.01 

.10 
-.04 
-.02 
-.01 
-.03 



Instructional Skills 

*Signif icance 
Leve 1 



.03 
N.S. 

N.S. 

N.S, 
N.S. 



N.S. 
-N.S. 
N.S. 

0 

N.S. 

9 

Personal Characteristics 



-.07 


N.S. 


.06 


N.S. 


.00 


N.S. 


.IS 


.09 



Instructional 
Skill h 



Zero Order *Signif icance 
Correlation Level 



Attending behavior 
exhibited 

Clarity of directions 



Responsibility 

Personal Grooming 

Acceptance of 
school norms 

Concern for school 



.13 
-.tl 3 

.16 
.13 
-.&7 



Questioning strate-" 
gies exhibited 

Reinforcing tech- 
niques exhibited 

Clarifying values 
exhibited 

Classroom management -.08 
tachniques 

Test- const ruction - .05 



Program evaluation . 
techniques exhibited 

Self-evaluation 
exhibited 

Teaching a unit 



-.07 
.00 
.00 
.09 



N.S. 
N.S. 

.08 

N.S. 

N.S. 

N.S.'' 

N.S. 

N.S. 

N.S. 

.06 



N.S. 
N.S. 
N.S. 
N.S. 
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